Real-time tracking and imitation of facial expression
نویسندگان
چکیده
We present a system for tracking facial expression and head pose with one camera and no special markers, and generating a face animation to imitate these expressions simultaneously. The tracking is based on Gabor wavelet coefficients (jets) of the facial feature points, a saccadic searching strategy, and a model-based adjustment. Using Principal Components Analysis (PCA), we established an expression model and use it to drive the imitation animation. The system runs in real-time and the tracking shows robustness against illumination/background variation, accumulative error and partial occlusion. The imitation animation captures both the expression and the head pose without 3D information.
منابع مشابه
Analysis and Synthesis of Facial Expressions by Feature-Points Tracking and Deformable Model
Face expression recognition is useful for designing new interactive devices offering the possibility of new ways for human to interact with computer systems. In this paper we develop a facial expressions analysis and synthesis system. The analysis part of the system is based on the facial features extracted from facial feature points (FFP) in frontal image sequences. Selected facial feature poi...
متن کاملRobust Real-Time Facial Expressions Tracking and Recognition
Enabling computer systems to track and recognize facial expressions and then infer emotions from about real time video is a challenging research topic. In this work, a real time approach to emotion recognition through facial expression in live video is introduced. Several automatic methods for face localization, facial feature tracker, and facial expression recognition are employed. A robust tr...
متن کاملEnhanced facial feature tracking of spontaneous and continuous expressions
The integration of multimedia technologies into mainstream computing have both raised the user’s expectations of computer interfaces, and made possible the development of multi-modal emotionally intelligent systems. The true strength of facial expression recognition (FER) shows when seamlessly integrated into emotionally intelligent systems enabling applications to add facial expressions to tra...
متن کاملMuecas: A Multi-Sensor Robotic Head for Affective Human Robot Interaction and Imitation
This paper presents a multi-sensor humanoid robotic head for human robot interaction. The design of the robotic head, Muecas, is based on ongoing research on the mechanisms of perception and imitation of human expressions and emotions. These mechanisms allow direct interaction between the robot and its human companion through the different natural language modalities: speech, body language and ...
متن کاملImitation System for Humanoid Robotics Heads
This paper presents a new system for recognition and imitation of a set of facial expressions using the visual information acquired by the robot. Besides, the proposed system detects and imitates the interlocutor’s head pose and motion. The approach described in this paper is used for human-robot interaction (HRI), and it consists of two consecutive stages: i) a visual analysis of the human fac...
متن کامل